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PREFACE 


In  the  operation  of  phased-array  radars  it  is  possible,  in 
principle,  to  save  power  without  sacrificing  performance  by  not 
deciding  in  advance  how  long  an  observation  should  be  made,  e.g. , 
through  sequential  testing.  In  practice,  some  limit  must  be  put  on 
the  freedom  of  the  designer  to  choose  observation  times--hence  the 
test  is  truncated.  This  Memorandum  describes  and  evaluates  a  class 
of  such  tests. 

The  work  was  undertaken  as  basic  research  in  technology  applicable 
to  the  design  of  electronically  scanned  radars  of  potential  use  in 
ballistic  missile  defenses.  It  is  part  of  a  continuing  study  for  ARPA 
on  low-altitude  defense  against  ballistic  missiles. 

Dr.  Julian  J.  Bussgang,  co-author  of  this  Memorandum,  is  President 
of  SIGNATRON,  Inc.,  Lexington,  Massachusetts,  and  is  a  Consultant  to 


The  RAND  Corporation. 
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SUMMARY 

Through  a  careful  examination  of  the  equations  by  which  Wald 
determines  the  values  of  the  boundaries  for  tests  of  sequential 
hypotheses,  we  are  able  to  obtain  interesting  relationships  for  the 
conditional  probability  distributions  of  the  stage  at  which  the  test 
terminates.  These  enable  us  to  study  sequential  tests  in  which  the 
boundaries  are  functions  of  the  sample  number.  We  are  particularly 
concerned  with  tests  with  convergent  boundaries,  and  investigate  a 
set  of  boundaries  which  approach  those  of  a  truncated  Wald  test. 
Approximate  expressions  for  the  expected  sample  number  and  probabil¬ 
ities  of  error  are  obtained  for  the  tests  considered.  The  obtained 
approximations  apply  best  for  gently  tapering  slopes.  Extensions 
of  our  method  can  be  applied  to  evaluate  various  ad  hoc  schemes  for 
truncating  tests  and  to  the  theory  of  tests  with  a  varying  parameter, 
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I.  INTRODUCTION 

The  sequential  test  of  statistical  hypotheses  as  analyzed  by 

Wald^  ^  entails  two  parallel  boundaries,  the  crossing  of  each  of 

which  is  associated  with  the  acceptance  of  one  of  the  two  alternate 

(2) 

hypotheses.  Although  a  proof  of  Stein'  '  provides  assurance  that  these 
tests  terminate  with  probability  1,  in  practice  it  is  frequently 
desirable  to  truncate  the  sequential  test  at  a  pre- determined  stage. 

The  truncation  can  occur  in  many  ways;  in  particular,  it  may  be  abrupt , 
i. e. ,  no  change  in  the  test  procedure  is  introduced  until  the  trunca¬ 
tion  stage  itself,  or  gradual ,  i.e. ,  the  test  procedure  is  modified 
at  every  stage  so  that  the  boundaries  monotonically  converge. 

A  difficulty  arises  in  the  treatment  of  truncated  sequential 
tests  in  that  the  boundaries  are  themselves  a  function  of  the  sample 
size,  which  is  a  random  variable.  Wald^  derived  certain  bounds  on 
the  probabilities  of  error  of  an  abruptly  truncated  test,  but  they 
do  not  appear  to  be  very  tight. 

The  main  purpose  of  this  Memorandum  is  to  determine  some 
approximate  relations  between  the  truncated  and  untruncated  tests. 

A  class  of  gradually  truncated  tests  is  considered.  Results  are 
obtained  for  the  Average  Sample  Number  and  for  the  probability  of 
accepting  an  alternate  hypothesis.  The  method  employed  is  based  on 
a  detailed  examination  of  the  relationships  used  by  Wald,  and  the 
hitherto  unnoticed  implied  relationships  for  the  conditional  probabil¬ 
ity  distributions  of  the  stage  at  which  the  test  terminates.  The 
same  method  can  be  extended  to  obtain  the  Operating  Characteristic 
and  to  generate  better  approximations. 
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II.  FUNDAMENTAL  RELATIONS 

Following  Wald^^  we  consider  sequential  tests  on  the  sequences 
x^,X2,...  of  identically  and  independently  distributed  random  varia¬ 
bles,  where  we  know  that  the  probability  measure  on  the  sample  space 
is  generated  by  one  of  two  probability  density  functions,  pQ sor  p 
It  is  the  purpose  of  the  sequential  alternate  hypothesis  test  to 
determine  which  of  the  density  functions  governs  the  observations. 

We  shall  use  the  standard  measure  on  the  infinite  sample  space  (the 

(3) 

extension  of  the  product  measure  of  finite  subspaces)'  '  and  assume 

that  the  density  functions  are  such  that  the  likelihood  ratios  are 

continuous  functions  of  xl9...,x  for  all  n. 

i  n 

The  sequential  test  is  performed  as  follows:  at  each  stage  in 
the  selection  of  the  sample  the  likelihood  ratio  is  formed.  This 
process  is  continued  as  long  as 

f q (m)  m  PL(x  )  f,(m) 

6  <  11  dTx)  <  6  >  m  =  l,2,...,n-l  (1) 

j  =  l  w 

and  ceases  at  some  stage  n  as  soon  as  one  of  the  inequalities  is 

violated.  For  the  sake  of  clarity  in  presentation,  the  terminal  stage 

is  denoted  by  n  as  distinguished  from  an  arbitrary  stage  m;  n  is  a 

random  variable. 

Let  Hq  and  represent  the  null  and  alternate  hypotheses  and 

let  a  and  |3  be  the  errors  of  the  first  and  second  kind.  We  associate 
a  violation  of  the  lower  inequality  with  the  acceptance  of  Hq  and  a 
violation  of  the  upper  inequality  with  the  acceptance  of  H^. 
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The  functions  f^Cm)  and  f^(m)  in  (1)  are  assumed  to  be  either 
constant,  or  monotonically  non-decreasing  and  non-incr easing ,  respec¬ 
tively.  In  either  case  the  test  terminates  with  probability  1  as 
long  as  f^m)  and  f-^(m)  are  bounded,  which  we  assume  to  be  the  case. 
The  object  of  this  Memorandum  is  to  study  truncated  tests;  truncation 
occurs  when,  for  some  value  of  m,  say  N,  fg(N)  =  f^(N),  since  at  this 
point  one  of  the  inequalities  in  (1)  must  be  violated.  (The  assump¬ 
tion  that  the  likelihood  ratio  is  continuous  precludes  the  possibility 
that  both  inequalities  be  violated  simultaneously  except  for  a  set  of 
paths  of  probability  zero.)  Notice  that  if  f^(N)  ^  0,  i=0,l,  we 
could  accept  a  hypothesis  when  the  likelihood  ratio  is  less  than 
unity,  i.  e.  ,  when  the  hypothesis  is  a  posteriori  less  likely.  It 
appears  reasonable  to  always  accept  the  a  posteriori  more  likely 
hypothesis.  Therefore  we  require  that  fp(N)  =  f^(N)  =  0  if  the  two 
hypotheses  are  a  priori  equally  likely  and  the  costs  of  incorrect 
decisions  are  equal.  If  the  two  hypotheses  are  not  equally  likely  or 
if  the  testlhas  different  costs  associated  with  the  acceptance  of  each 
hypothesis,  the  value  of  f^N)  (i=0,l)  at  truncation  would  not 
necessarily  be  zero  but  would  depend  upon  the  ratio  of  b  priori 
probabilities  and  costs. 

Let  Pp"(n)  and  (n)  be  the  probability  measures,  corresponding 
to  Hq  and  H1,  of  the  set  of  paths  x^  x2,... ,x^  which  cause  the  lower 
inequality  in  (1)  to  be  violated  for  the  first  time  at  the  nth  stage. 
(The  notation  is  similar  to  Wald's:  the  single  and  double  asterisks 
indicate  the  condition  that  the  process  exceeds  the  lower  and  upper 
bounds,  respectively.  The  subscript  i=0 , 1  indicates  which  hypothesis 
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ids  ids 

is  true.)  Similarly  (n)  and  |j,  (n)  are  these  quantities  with 

respect  to  the  upper  inequality.  We  define  the  following  conditional 
probability  density  functions 

*  ** 

*  ** 

p.  (n)  =  -5 -  ,  p  (n)  =  -» -  (i=0,l)  (2) 

n=  1  n= 1 

** 

where,  for  example,  p^  (n)  is  the  probability  that  the  test  termi- 
th 

nates  at  the  n  stage  conditioned  by  the  facts  that  is  the  true 
hypothesis  and  that  the  upper  inequality  is  the  one  which  is  violated. 
Based  on  these  conditional  probability  density  functions,  correspond¬ 
ing  conditional  expectations  can  be  calculated.  They  are  denoted  by 

is  is  ids  ids 

Eq  (n)  ,  E^  (n)  ,  Eq  (n)  and  E1  (n) . 

In  the  following  we  restrict  our  attention  to  the  upper  inequality, 
the  violation  of  which  results  in  the  acceptance  of  H^;  similar  results 
hold  for  the  lower  inequality  resulting  in  the  acceptance  of  H^.  Let 
x^,... ,x^  be  a  sample  path  that  results  in  the  violation  of  the  upper 
inequality  at  the  n^  stage.  Then 

f  ^(n) 

pl(*l)  P1(x2).  .  •P1(xn)  P0(XP  P0(x2)  •  •  •  PqO^)  (3) 

Let  S  be  the  set  of  n-tuples  for  which  the  above  inequality  holds, 
conditioned  by  the  fact  that  expression  (1)  was  satisfied  at  the  n-1 
previous  stages.  Then 


I*  „n  fj_(n) 

ill  p  (x  )dji(x  ,.  .  .  ,x  )  e 
JS  i=l 


S 


n 

n  P0(xi)d|i(x1,  . 
i=  1 


(4) 
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where  p  is  n- dimensional  Lebesque  measure.  The  existence  of  these 
integrals  is  easy  to  verify;  Eq.  (4)  is  equivalent  to  the  following 
statement,  which  better  suits  our  purposes. 


M- 


f-,  (n) 
>  e  P 


** 

0 


(n) 


(5) 


Furthermore,  we  shall  assume  that  the  inequality  in  (5)  is  in  fact 

an  equality.  The  implications  of  this  assumption  will  be  discussed 

at  the  end  of  Section  III.  Wald  makes  the  same  assumption,  which  is 

often  described  as  "neglecting  the  excess  over  the  boundaries,"  when 

f  1(n) 

he  lets  the  constant  upper  threshold  A  (i.e. ,  e  =  A  >  1)  be 

CO 

n 

equal  to  (l-g)/a.  Since,  in  the  Wald  test  (n)  =  1_P  and 

n=l 

os 

y  |j,  *”  (n)  =  a,  the  analog  of  Eq.  (4)  is  l-j3  >  A  a-  Setting  A  = 
n=l 

(l-3)/a  implies  that 

p1  (n)  =  A  PQ  (n)  (6) 


for  all  n.  Since  all  the  quantities  are  positive  this  follows  for 
the  following  reason:  if,  for  any  n,  the  left-hand  side  in  Eq.  (6) 
were  greater  than  the  right-hand  side,  the  sums  over  all  n  would  give 
A  <  (1-p)  /a,  which  contradicts  the  assumption  that  A  =  (l-PJ/o?.  The 

p  *“(n)  =  1-p  should  be  obvious;  this  is  simply  the 

n=l 

probability,  given  that  is  true,  that  the  test  gives  the  correct 

CO 

answer.  Similarly,  £  Pq"* (n)  =  a  is  the  probability  of  error  when 

n=  1 


:  equation 


I 


/ 
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Hq  is  the  true  hypothesis. 

With  respect  to  the  Wald  test,  the  conditional  probabilities 
given  in  Eq.  (2)  are 


**  t  V 

(n) 

1-3 


** 

Pn  00 


(n) 

at 


(7) 


Thus  we  have  the  following  lemma  and  its  corollaries: 

LEMMA  1: 

Consider  a  Wald  test  (neglecting  the  excess  over  the  boundaries) 

which  leads  to  the  acceptance  of  the  alternate  hypothesis  (H^) .  For 

such  a  test,  the  conditional  probability  density  function  that  the 
til 

test  ends  at  the  n  stage,  given  that  the  null  hypothesis  (H^)  is 

true,  is  equal  to  the  conditional  probability  density  function  that 

the  test  ends  at  the  n^  stage,  given  that  the  alternate  hypothesis 

(H^)  is  true;  i. e. ,  p^  (n)  =  p^  (n)  for  all  n.  (Similarly,  in  the 

•k  •k  ' 

case  when  is  accepted,  p^  (n)  =  p^  (n) . )  (See  footnote.) 

Corollary  1. 1 

In  a  Wald  test  the  conditional  moments  of  the  sample  size,  when 
they  exist,  are  all  equal,  i. e. , 

Eq  (nr)  =  Ej^  (nr)  ,  EQ  (nr)  =  (nr) 


Note:  This  symmetry  relationship  on  the  conditional  distribution  of 

n  was  first  observed  by  Bussgang  and  Middleton  (Ref.  4)  under  certain 
specific  conditions  on  the  probability  density  function  of  the  log¬ 
arithm  of  the  probability  ratio.  The  normal  distribution  was  ob¬ 
served  to  satisfy  these  conditions. 
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Corollary  1. 2 

Referring  to  the  general  test  defined  in  Eq.  (1)  under  the  assump¬ 
tion  that  Eq.  (5)  is  an  equality,  the  following  equalities  are 
established 


(Similar  results  are  obtained  when  is  accepted.) 

Both  the  lemma  and  its  corollaries  hold  if  the  observations  x^, 
x0 , . . .  are  not  independent.  The  independence  of  the  samples,  assumed 
in  Section  II,  is  actually  first  necessary  in  the  next  Section  in 
calculating  the  Average  Sample  Number. 
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III.  TESTS  WITH  GENTLY  SLOPING  BOUNDARIES 
I  Consider  the  modified  sequential  alternate  hypothesis  test  defined 

i 

in  expression  (1)  for  which 

Vn>  =  ci  -  §>  0 
f  ]_  (n)  =  a  C1  “  f)  1 

where  0  <  r^,  r^  <;  1  and  ’a  and  T)  are  positive.  The  graph  of  f^(n)  is 
shown  in  the  accompanying  figure.  In  what  follows  the  tilda  sign  (~) 
distinguishes  the  quantities  characterizing  the  modified  test  from 
the  corresponding  quantities  in  the  Wald  test. 


A  class  of  upper  boundaries  of  the  truncated  test 


The  graph  of  fg(n)  is  similar. 

If  we  rewrite  expression  (1)  for  the  logarithm  of  the  likelihood 


ratio  we  obtain 
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r  n  surO  V  i  Pl(xi}  ~  n  2/1 

b  ^  N  <  L  l0§  Pn(x.)  <  a  (1 

j  =  l  °  J 


(ID 


m  =  1,  2,...,  n-1 


This  is  the  equation  which  first  interested  the  authors  and  provided 
the  motivation  for  the  relationships  shown  in  Section  II.  In  partic¬ 
ular,  if  we  consider  the  case  where  p^(x)  =  N(i,a)  (normal  distribu¬ 
tion  with  mean  i  and  variance  a)  then  Eq.  (11)  defines  a  random  walk 
(sums  of  independent  random  Gaussian-distributed  variables)  with 
convergent  absorbing  boundaries. 

Let  if.  (n)  (i=0,l)  be  the  average  test  length  for  the  test  de¬ 
fined  in  Eq.  (11),  conditioned  by  the  fact  that  1L  is  the  true 
hypothesis,  and  let  a  and  |3  be  the  errors  of  the  first  and  second 
kind  for  the  test.  We  shall  obtain  approximate  values  for  all  of 
these  quantities.  Note  that  as  N  -*  °=,  Eq.  (11)  defines  the  standard 
Wald  test  where  af  =  log  A  and  'B'  =  -  log  B.  We  require  that  af/N  and 
-b’/N  be  small;  this  is  what  we  mean  by  gently  sloping  boundaries, 
since  in  the  r^  =  1  case,  -a/N  is  the  slope  of  f^(n) ;  in  general 
-r^a/N  is  the  derivative  of  f^(n)  at  n=0.  Similar  results  apply  to 
fQ(n)  with  af  replaced  by  b. 

Since  a/N  and  -b/N  are  small,  the  tests  that  we  are  examining 
are  very  close  to  the  Wald  test,  whose  boundary  begins  with  the  same 
value.  They  might  be  considered  as  Wald  tests  with  slightly  modified 
boundaries.  This  is  significant  since  a  meaningful  interpretation 
of  our  results  is  obtained  by  comparing  the  class  of  tests  discussed 
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here  to  the  Wald  test  with  a  =  a  =  log  A,  b  =  b  =  -  log  B. 

In  the  following  we  assume  that  a  and  (3  are  very  small  so  that 
1 -ff  1  and  1-^  ps  1.  This  assumption  is  not  necessary  but  it  greatly 

simplifies  the  resulting  expressions.  Following  this  assumption  the 
equation 


E^n)  =  'P  E^Cn)  +  (1-p)  ^**(n) 


(12) 


is  replaced  by 


^  'k'k 

E^n)  =  Ej  (n) 


(13) 


Now,  setting  u  =  —  and  z. 
’  N  j 


Pl^j) 


log  ; — hr,  we  use  a  well-known  result  of 


(1  3) 

sequential  analysis,  3  together  with  the  often-mentioned  neglect 


of  excess  over  the  boundaries,  to  obtain  two  equalities: 


E1(z1+ . +zn)  =  Ex(n)  El(z) 


(14) 


and 


E1(z1+ . +zn)  =  M 


*  [-b  (1-u)  C 


_  J— J- 

+  (1-ft 


a  (1-u) 


(14a) 


When  «  1,  the  first  ternrgon  the  right-hand  side  of  (14a)  can  be 
ignored  and  by  Eq.  (13)  we  obtain 


JL.J-  ^  -1 

Ej_  (n)  E1(z)  w  Ex  a  (1-u)  j 


,4  [.  - 


rl(rl~l)  2 
r!U  +  - 2 -  U 
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Thus 


^**(10  «  E^n) 


£ 


_ a _ 

E1(z)  + 


(15) 


where  we  neglect  all  the  conditional  moments  of  u  higher  than  the 

first.  The  reason  for  this  will  be  discussed  below. 

~  ^  rl 

In  order  to  obtain  a  we  use  Eq.  (9)  with  f^(n)  =  a'  (1-u)  ,  so 

that 


(16) 


Taking  in  account  our  approximation  l-(3  «  1,  neglecting  the  condi¬ 
tional  moments  of  u  higher  than  the  first  in  the  Taylor  series  expan- 

, — ,  •k'k 

sion  about  u=0,  and  substituting  Eq.  (15)  for  (n) ,  we  get 


a  £?*  e 


i  + 


ria 


N  E^(z)  -f  r^a" 


07) 


Equations  (15)  and  (17)  apply  when  the  null  hypothesis  is  true,  by 

replacing  a  by  -t>,  a  by  p  and  E^(n)  by  E^(n). 

Now  consider  the  Wald  test  with  upper  boundary  ea  and  lower 
boundary  e  ^  and  let  a  and  (3  be  the  probabilities  of  error  of  the 
first  and  second  kind.  If  a  and  P  are  very  small,  E^(n)  ^  a/E^(z) 

and  e  3  «  a.  Suppose  'a  =  a,  i. e. ,  the  boundaries  of  the  Wald  test 

and  the  modified  test  begin  (n=0)  at  the  same  points.  We  get  from  Eq. 

05) 
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E^n) 


£ 


E1(n) 


(n) 


(18) 


and  in  place  of  Eq.  (17)  we  have 


0 !  W  ff 


rLa  E1(n) 

N  +  r  i  E1(n) 


(19) 


From  Eq.  (18)  we  see  that  E^n)  /  (1+r ^  <t'1(n)  ^  E^(n)  ;  this  is  to  be 
expected  since,  because  of  the  truncation,  the  tests  which  we  con¬ 
sider  must  have  a  shorter  expected  test  length.  However,  because  of 
the  optimality  of  the  Wald  test  the  probability  a  must  be  greater 
than  a,  as  it  is  (see  Eq.  (19)).  In  fact,  if  c?  were  set  equal  to  a 
we  would  expect  the  corresponding  test  with  converging  boundaries  to 
have  a  greater  expected  length  than  the  Wald  test.  This  in  turn 
implies  also  that  the  truncated  test  must  begin  at  a  >  a. 

In  review,  a  is  the  probability  of  error  of  the  first  kind  for 
a  Wald  test  with  upper  boundary  ea.  The  probability  'a  is  the  prob¬ 
ability  of  error  of  the  first  kind  for  a  test  with  upper  boundary 
exp  [■  ■■  ■  p’i  ,  where  we  no  longer  assume  that  a  =  a  but  assume 
a  =  a.  It  is  immediately  obvious  that  under  those  conditions  a  >  a, 
since  by  (17) 


a  =  a  ps  e 


1  + 


rla 


N  E-^z)  +  r  a 


(20) 


since  <y  =  e  and  the  term  in  the  brackets  is  greater  than  1. 
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Two  additional  questions  of  interest  need  clarification.  First, 
in  calculating  the  conditional  moments  of  u  =  ^  we  disregard  all 
moments  except  the  first.  Actually  when  we  first  obtained  our 
results  we  included  the  first  two  moments  and  argued  that  the  third 

icic 

moment  could  be  neglected.  This  was  because  u  >  1  so  that  (u)  > 

E^""(u  )  >  (u ) ,  and  further  it  is  reasonable  to  believe  that 

these  inequalities  are  non-trivial.  Also  in  the  expression  of  the 

O 

u  term  in  Eqs.  (15)  and  (17)  the  coefficient  is  dominated  by  1/(3.'). 

Thus  we  satisfied  ourselves  that  only  the  first  two  moments  had  to  be 

included.  To  evaluate  the  equations  including  the  first  two  moments 

2 

we  obtained  an  expression  for  E^(n  )  (i— 0,1)  from  the  two  additional 
equations . 


E. 

l 


(n2) 


E.  (z) 


+  E^~(n) 


2 

1 


(21) 


The  expressions  that  we  then  obtained  for  Eqs.  (15) ,  (17) ,  (18)  and 
(19)  were  cumbersome  and  added  no  easy  insight  into  the  behavior  of 
the  tests.  Thus  we  decided  to  display  our  results  with  only  the 
first  moment  incl  uded.  Greater  accuracy  can  be  obtained  by  includ¬ 
ing  the  second  moments  if  this  is  desired. 

By  keeping  only  the  first  moment  of  u  in  Eq.  (14)  and  in  the 
results  which  follow,  we  are  essentially  approximating  the  boundaries 
of  the  converging  test  by  straight  lines.  The  implication  is  that 
the  behavior  of  the  test  with  linear  boundaries  corresponds  to  the 
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behavior  of  the  test  with  the  actually  specified  boundaries.  Reten¬ 
tion  of  higher  moments  of  u  results  in  using  higher-order  polynomial 
approximations.  It  appears  that  there  is  no  restriction  on  the  order 
of  polynomial  approximation  that  can  be  tried  (if  the  distribution  of 
z,  the  logarithm  of  the  likelihood  ratio,  is  known)  although  the 
calculations  grow  increasingly  more  cumbersome. 

The  second  question  deals  with  the  assumption  that  Eq.  (5)  is 

an  equality.  This  is  equivalent  to  assuming  that  for  all  the  sample 

paths  that  result  in  the  violation  of  expression  (1)  at  the  upper 
til 

limit  at  the  n  stage,  the  equality  is  achieved.  In  other  words, 
f  L(n) 

considering  e  as  an  upper  boundary,  we  neglect  the  excess  over 

the  boundary.  The  validity  of  this  assumption  depends  upon  the  pro¬ 
perties  of  the  stochastic  processes  generated  by  the  density  func¬ 
tions  Pq  and  p  .  If  almost  all  the  paths  of  the  processes  are 
continuous  and  if  the  upper  and  lower  boundaries  are  continuous, 
then  we  can  devise  continuous  tests  for  which  this  assumption  is 
satisfied  (see  also  Ref.  5).  However,  for  specific  density  functions 
Pp  and  p^  not  of  this  class  one  must  decide  the  extent  to  which  the 
results  obtained  in  this  Memorandum  apply. 

We  note  further  that  for  the  boundaries  given  at  the  beginning 
of  this  section,  the  assumption  of  equality  in  (5)  becomes  more 
strained  as  the  boundaries  converge,  especially  if  the  procedure  can¬ 
not  be  approximated  by  a  continuous  procedure.  If  we  let  the  para¬ 
meters  r^  and  r^  approach  zero,  the  test  under  consideration  is  the 
Wald  test  with  a  final  decision  at  the  Nth  stage  (determined  by 
whether  the  likelihood  ratio  is  greater  or  less  than  1).  However, 
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at  this  stage  there  is  clearly  excess  over  the  boundaries.  Even  by 
passing  to  continuous  tests,  our  results  do  not  apply  when  parallel 
boundaries  are  abruptly  truncated  because  the  boundaries  are  discon¬ 
tinuous  at  the  last  stage.  That  is  why  Eqs.  (15),  (17),  (18)  and  (19) 
are  meaningless  for  r^  =  r^  =  0.  These  equations  give  the  results 
for  the  Wald  test,  but  that  is  because  our  assumption  of  neglecting  i  : 
the  excess  over  the  boundary  results  in  our  neglecting  the  stage  at  7  .  j 
which  truncation  takes  place. 

A  comment  is  in  order  on  the  closeness  of  the  approximate  equali¬ 
ties  (15)  and  (17).  In  the  case  of  r^  =  1,  we  can  compare  our  results 
with  the  exact  results  calculated  by  T.  W.  Anderson  for  a  Wiener 
process.  ^  For  example,  for  s'  =  3.981,  N  =  600.25  and  E^(z)  =  0.02, 
our  result  (Eq.  (15))  yields  Ef  (n)  =  149  rather  than  139.2;  for 
'a.  =  7.104,  N  =  870.26  and  E^(z)  =  0.02,  the  approximation  (15)  gives 
E^(n)  =  252  in  place  of  249.4.  Our  approximation  for  E^(n)  appears 
therefore  quite  satisfactory  in  these  cases.  The  approximate  expression 
(17)  gives,  in  the  same  two  cases,  a?  =  0.023  and  0.0064  in  place  of 
0.05  and  0.01.  Since  the  right-hand  side  of  (17)  is  a  truncated 
expansion  of  an  exponential  series  with  a  positive  exponent,  it  is 
not  surprising  that  (17)  understates  the  value.  The  approximations 
improve  as  r^  decreases.  When  r^  >  1,  the  curvature  of  the  boundaries 
is  reversed,  the  initial  slope  is  no  longer  gentle  and  expressions 
based  on  just  the  first  two  terms  of  a  polynomial  expansion  will  not, 


in  general,  suffice. 
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IV.  CONCLUSIONS 

In  most  applications  of  the  sequential  procedure  it  is  desir¬ 
able  to  set  a  definite  upper  limit  for  the  number  of  observations. 

This  can  be  achieved  by  changing  the  rules  of  procedure  in  such  a 
way  that  by  a  certain  stage  N  the  acceptance  and  rejection  regions 
meet,  eliminating  the  "defer  decision"  region  of  the  original 
sequential  test  of  Wald.  The  original  Wald  procedure  involves  two 
parallel  boundaries  which,  in  the  application  of  this  procedure  to 
detection  problems,  can  be  implemented  as  two  fixed  thresholds 
against  which  the  detector  output  is  compared.  No  decision  is  made 
as  long  as  the  detector  output  remains  between  the  two  thresholds. 

Parallel  boundaries  are  a  consequence  of  assuming  that  the  observa¬ 
tions  are  independent , J that  the  cost  of  taking  each  observation  is  the  same, 
and  that  the  time  and  hypothesized  probability  distributions  remain  un¬ 
changed  throughout  the  test.  If  the  cost  of  each  observation  were  to 
increase  as  the  test  progressed,  the  test  boundaries  would  monotonically 
converge.  The  class  of  modified  test  procedures  analyzed  in  this  Memoran¬ 
dum  possesses  this  property.  A  practical  interpretation  of  such  boundaries 
is  that  the  urgency  to  terminate  the  test  becomes  greater  as  the  trunca¬ 
tion  point  is  approached.  Another  interpretation  is  that  the  absolute 
value  of  the  logarithm  of  the  likelihood  ratio  is  expected  to  decrease 
with  the  progress  of  the  test.  This  would  occur  if  the  two  hypotheses 
converge. 

The  approximations  made  in  this  Memorandum  imply  that  the 
truncation  point  is  sufficiently  beyond  the  Average  Sample  Number 
so  that  most  tests  terminate  before  the  truncation  point  is  reached. 

Thus  events  at  the  truncation  point  itself  can,  in  fact,  be  ignored. 
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the  boundaries  have  no  slope  (r-0) ,  the  truncation  stage  » 
disappears  from  the  equations  and  the  test  behaves  as  the  original 

Wald  test. 

The  general  method  of  analysis  presented  in  this  Memorandum  xs 
to  approximate  non-constant  boundaries  by  polynomials  in  the  stage 
number.  The  approximation  actually  used  here  to  illustrate  the 
method  is  to  retain  only  the  first  two  terms  of  the  binomial 
expansion  of  (l-u)r.  A  further  study  is  required  to  determine  the 

best  polynomial  approximation  of  a  given  degree. 

The  modification  of  the  boundaries  changes  not  only  the  Average 
Sample  Number  but  also  the  probabilities  of  error  of  the  first  and 
second  kind.  Specifically,  the  probabilities  of  error  increase 
'relative  to  a  test  whose  boundaries  begin  at  the  same  points  and 
'j remain  parallel.  The  probabilities  of  error  of  the  modified  test  can 
be  made  to  equal  those  of  the  unmodified  test  only  if  the  boundaries 
of  the  former  begin  outside  those  of  the  latter. 

It  should  be  remarked  that,  in  our  opinion,  the  optimality  of 
the  sequential  test  is  intimately  related  to  the  equality  of  condi¬ 
tional  probabilities  of  terminating  the  test  proved  in  Section  II  of 
this  Memorandum.  We  have  work  in  progress  which  attempts  to  develop 
a  simple  proof  of  the  optimality  of  sequential  tests  based  on  this 

property  of  the  Wald  test. 

The  results  presented  in  this  Memorandum  apply  to  cases  when 
either  one  or  both  boundaries  are  gently  sloped  towards  the  trunca¬ 
tion  point.  We  have  encountered  this  situation  in  the  study  of 
sequential  estimation.  Additional  applications  of  these  results 
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should  arise  in  problems  of  random  walk  since  sequential  tests  can 


be  regarded  as  a  random  walk  with  absorbing  barriers. 
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